Skip to content

2026 State RPS / CES /Hydrofrac Update#11

Open
Yunzhi-Chen wants to merge 18 commits into
mainfrom
yc/26statepolicy
Open

2026 State RPS / CES /Hydrofrac Update#11
Yunzhi-Chen wants to merge 18 commits into
mainfrom
yc/26statepolicy

Conversation

@Yunzhi-Chen

@Yunzhi-Chen Yunzhi-Chen commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Summary

Annual update of state RPS / CES / voluntary policy inputs in state_policies/ to the June 2026 LBNL release of "RPS & CES Targets and Demand". The three CSVs ReEDS consumes — rps_fraction.csv, ces_fraction.csv, and hydrofrac_policy.csv — are regenerated from the new data.

Technical details

Two upstream data sources were refreshed:

  1. LBNL state RPS / CES dataset (Galen Barbose):
    RPS & CES Targets and Demand_June 2025.xlsxRPS & CES Targets and Demand_June 2026.xlsx.
    The June 2026 release renamed several sheets and shifted header rows:
    • Statewide LoadStatewide Sales
    • RPS & CES Demand ProjectionsRPS & CES Demand (GWh)
    • LBNL also removed the Non-RE Accounting sheet from the public workbook. Galen sent it directly to Wesley, and it was pasted back into the workbook as a sheet named Non-RE Accounting so the script's input is self-contained.
  2. NLR Green Power Data (used for the voluntary RPS row):
    nrel-green-power-data-v2023.xlsxnrel-green-power-data-v2024.xlsx. The 2024 release added one more historical year (2024) and revised earlier years' market-wide estimates downward, which propagates into a uniformly lower voluntary trajectory in rps_fraction.csv.

Implementation notes

Changes in state_policies/data_processing.py are all configuration at the top of the file — no algorithmic changes:

  • filenameRPS & CES Targets and Demand_June 2026.xlsx
  • filename_voluntarynrel-green-power-data-v2024.xlsx.
  • Voluntary historical-year cap in the projection block bumped from <= 2023 to <= 2024 so the new 2024 data point is included in rps_series rather than projected; projection still extrapolates to 2050 using the minimum year-over-year growth in the historical series.
  • base_year bumped from 2023 to 2025. Years strictly before base_year are passed through as raw values from the LBNL workbook, while years ≥ base_year go through the change-point detection + linear interpolation + monotonic max pipeline.
  • hydro_year (for gen_ann.csv) kept at 2023 to stay time-consistent with the vintage of Galen's Non-RE Accounting numerator data (2022–2023 reports).

Additional changes

  • Rewrote state_policies/README.md.
  • Replaced old and new data comparison/old and new data comparison.ipynb with old and new data comparison/generate_comparison_plots.py, which produces standardized PNGs from the old and new outputs.
  • Staged the previous run's outputs in old and new data comparison/old ReEDS input/ so the diffs/plots are reproducible by reviewers.

Issues resolved

Closes #122.

Relevant sources or documentation

image

2025 vs 2026 comparisons

hydrofrac_CES_comparison hydrofrac_RPS_All_comparison ces_fraction_comparison rps_wind_comparison rps_solar_comparison rps_all_comparison

Additional details

  • Output verification: Ran python data_processing.py to regenerate all six before/after PNGs in old and new data comparison/plots/. Spot-checked notable state-level changes against the LBNL summary slides (e.g., the CT RPS decline traces to the Class I / LFG / biomass eligibility change cited above). Voluntary trajectory verified; the uniform downward shift matches NLR's revised market-wide estimates in v2024.
  • LLM usage: Used GitHub Copilot (chat) to assist with editing data_processing.py for the new LBNL sheet layouts, drafting the README's annual-update procedure, writing generate_comparison_plots.py, extracting text from the LBNL summary-slides PDF when investigating the CT decline, and locating the v2024 NLR file. All resulting code/text was reviewed and the regenerated CSVs were spot-checked against the source workbooks before committing.

@Yunzhi-Chen Yunzhi-Chen changed the title Yc/26statepolicy 2026 State RPS / CES /Hydrofrac Update Jun 22, 2026
@Yunzhi-Chen Yunzhi-Chen self-assigned this Jun 23, 2026
@Yunzhi-Chen Yunzhi-Chen requested a review from wesleyjcole June 23, 2026 17:22
Comment thread state_policies/outputs/intermediate outputs/ces_fraction_intermediate.csv Outdated
Comment thread state_policies/data_processing.py Outdated
Comment thread state_policies/data_processing.py Outdated
Comment thread state_policies/README.md Outdated
Comment thread state_policies/README.md Outdated
Comment thread state_policies/README.md
| `RPS & CES Targets and Demand_June 2026.xlsx` | Annual LBNL state RPS / CES dataset, provided by Galen Barbose. Source: https://emp.lbl.gov/projects/renewables-portfolio. The script reads four sheets from this file: `Statewide Sales`, `RPS & CES Demand (GWh)`, and `Non-RE Accounting`. Note: starting with the June 2026 release LBNL no longer publishes the `Non-RE Accounting` sheet in the public workbook. Galen sends it separately to NREL, and we paste it back into this file as the `Non-RE Accounting` tab so the workbook is self-contained. |
| `nrel-green-power-data-v2024.xlsx` | NLR Green Power Data (formerly NREL), used for the voluntary RPS row. Source: https://www.nlr.gov/analysis/voluntary-power-procurement. |
| `RPS_nonUS.csv` | Non-US RPS data provided by the ReEDS team (currently only Nova Scotia, `NS`). |
| `hierarchy.csv` | Region hierarchy from a recent ReEDS Reference run, used to map BAs to states for the hydrofrac calculation. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you give a version number or date rather than "recent" to make things clearer down the road?

Comment thread state_policies/README.md
| `nrel-green-power-data-v2024.xlsx` | NLR Green Power Data (formerly NREL), used for the voluntary RPS row. Source: https://www.nlr.gov/analysis/voluntary-power-procurement. |
| `RPS_nonUS.csv` | Non-US RPS data provided by the ReEDS team (currently only Nova Scotia, `NS`). |
| `hierarchy.csv` | Region hierarchy from a recent ReEDS Reference run, used to map BAs to states for the hydrofrac calculation. |
| `gen_ann.csv` | Annual generation by tech and BA from a recent ReEDS Reference run, used to compute hydro / non-RE shares for the hydrofrac calculation. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here.

Comment thread state_policies/README.md
Comment thread state_policies/README.md Outdated
Yunzhi-Chen and others added 10 commits June 24, 2026 13:37
Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants